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CURRICULUM COMMITTEE MEETING 
20 November 1985 

1000 - 1200 Hours, D/OTE Conference Room 

eT/? Ttr 


- Fourth Quarter Review; Analysis Training 

^ r\o TkAr* a t-q ^ 


- Approval ot NeVr Course List and Deletion List 

(attached) 

- Develop Schedule for Course Reviews (attached) 

- Software Evaluaton and Implementation 

- Certificates for Exceptional Speakers 

- Curriculum Overlap on Testing (attached) 

- d 0 ‘ 6 ' ^ IPOC/^ 


ATB/ITD 

All 

All 
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28 October 1985 


MEMORANDUM FOR: Director of Training and Education 


FROM: 

SUBJECT; Report on the 26 June 1985 Conference of the 

Evaluation Panel on CIA Analysis Training 


STAT 


All members of the Evaluation Panel have approved the 
attached report on the 26 June 1985 Conference, including 
Helene Boatner and Robert Dorn, who did not attend the 


Conference . 



STAT 
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10 September 1985 


MEMORANDUM FOR: Director of Training and Education 
FROM: Evaluation Panel on CIA Analysis Training 

SUBJECT: Report on the 26 June Conference 


SUMMARY OF THE CONFERENCE 

1. The representatives of the Directorate of Intelligence 
and the non-CIA participants in the 26 June conference agreed 
to constitute a continuing Curriculum Evaluation Panel on CIA 
Analysis Training. 

2. The Evaluation Panel strongly endorsed the quality and 
utility of the three courses under review: New Analyst Course 
(NAC); Seminar on Intelligence Analysis (SIA) ; and Seminar on 
Intelligence Successes and Failures (ISF). 

3. The principal recommendations by the Panel for 
increasing the impact of the courses on the Directorate were; 

a. That the NAC introduce a unit on Concept Papers, 
include more research-oriented materials and tasks in its 
exercises, and increase the time devoted to computer skills. 

b. That SIA experiment with clusters of students 
from three or four offices or divisions. 

c. That ISF accept less-experienced analysts on the 
recommendation of their division chief. 

4. The next meeting of the panel is scheduled for 

10 January 1986. Because of the concerns expressed by Panel 
members about the training of branch chiefs, the meeting will 
concentrate on training of branch chiefs, especially the 
Supervision of Analysis Seminar. 

THE CURRICULUM EVALUATION PANEL 

The participants at the 26 June conference agreed to 
constitute a continuing Curriculum Evaluation Panel on CIA 
Analysis Training. 
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The Deputy Director for Intelligence selected the following 
members for the Panel: 

Richard Kerr , Associate Deputy Director. 

Helene Boatner , Director, Office of Management, 
Planning and Services.* 

Director, Office of Global Issues. 

Chief, National Issues Group, 

Office of Soviet Analysis. 

John Helqerson , Director, Office of African and 
Latin American Analysis. 

The Director of Training, in conjunction with the Deputy 
Director for Intelligence, selected the non-CIA members of the 
Panel . 


Dr. Richard Betts , Brookings Institution. 
Professor Robert Jervis , Columbia University. 
Robert Dorn, Center for Creative Leadership.* 


The following CIA officers have also agreed to serve as 
members of the Panel: 


Office ot T 


Associate 
raining . 


Director 


for Curriculum, 


Senior Training Officer, 
Directorate ot Intelligence 


Office of Training, will serve as Executive 
Secretary to the Panel and as Conference Coordinator. 


EFFECTIVE TRAINING 

As indicated in the background paper for the conference (at 
annex to this report), the Director of Training and Education 
has established the Evaluation Panel to strengthen the 
curriculum of courses on analysis training offered on the 
behalf of the Directorate of Intelligence. In opening the 
conference, he stated that his goal was to solicit the advice 
of Directorate managers and outside experts for making an 
already strong program the best of its kind in the country. 


STAT 


STAT 

STAT 

STAT 


*Did not attend the 26 June conference, but have approved this 
report and agreed to serve on the Panel. 
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The Director of Training and the Evaluation Panel agree that 
achievement of this goal will require regular review of the 
curriculum to see that in fact the courses individually and 
collectively meet the priority needs of the Directorate in the 
area of analysis training. The effectiveness of the program also 
depends on the availability of high-quality and well-supported 
course directors, who command the respect not only of the 
participating students but also of the Directorate managers who 
sponsor them. 

EFFECTIVE ANALYSIS AND ANALYSTS 

The first substantive discussion addressed definition of the 
special requirements of and recurring barriers to effective 
analysis that should undergird the curriculum. The Evaluation 
Panel endorsed the list elaborated in the conference paper 
(pages 3-5): 1) Policy Relevance; 2) Ambiguous Information; 

3) Effective Use of Assumptions; 4) Over- and Under-Confidence; 

5) Clarifying Levels of Confidence; and 6) Alternate Analysis. 

The DI Panel members, however, produced a list of the 
attributes of an effective analyst , which they believe also 
require priority attention in the curriculum. 

1. Effective command of "tools," especially writing, 
briefing, and computer skills. 

2. Readiness to perform the full range of roles of an 

intelligence analyst (e.g., developing data bases as well as 
publishing current intelligence). The standard presented to 
analysts should be "Perform or Perish," not "Publish or 
Perish." 

3. Greater understanding of the substantive review 
process, and command of the skills to facilitate it (e.g., 
eliciting and giving feedback). 

4. Ability to use Concept Papers effectively, to 
clarify the purposes and audience of assessments, and thus to 
speed the review process. 

5. Effective relationships with counterparts throughout 
the Agency and Intelligence Community. 

The first two items on the list fall almost exclusively in the 
province of the New Analyst Course. But the list in general will 
serve as another standard for testing the scope and emphasis of 
the syllabi of all analysis training courses. 

For example, the Seminar on Intelligence Analysis can address 
facilitation of the review process in its coverage of utility 
analysis. And the Seminar on Intelligence Successes and Failures 
can emphasize Concept Papers in its coverage of policy relevance. 
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GENERAL EVALUATION OF THE COURSES 

The Panel members present at the conference strongly endorsed 
the quality of the courses under review and their utility for the 
Directorate of Intelligence. The DI managers, while they tabled 
most of the specific criticisms, were also the most outspoken in 
expressing appreciation of the program. 

Dick Betts and Bob Jervis, the non-CIA panelists who attended 
the conference, were more tentative in both their criticism and 
their praise — reflecting their initial limited exposure to both 
the purposes and performance of the courses. However, they both 
brought to bear their broad experience on the general subject of 
effective intelligence analysis, and thereby helped to define some 
of the inherent tradeoffs confronting the program (e.g., between 
emphasis on basic skills and on creative analysis). 

NEW ANALYST COURSE (NAC) 

The NAC evoked the most attention at the conference — 
testimony to its importance to DI managers during a period of 
unprecedented influx of new analysts. 

The Panel strongly endorsed the value of the NAC for the 
students and for the Directorate. The Panel agreed that the 
course's length should not be extended beyond its present six 
weeks; and that it should remain a "survi ^l cou rse," 
concentrating on the skills and valutrs llSw^ analysts need to 
survive their three-year period of probation. 

Bob Jervis noted, however, that the "model" of a single full 
time and relatively short course sets the limits for its values, 
within which only marginal improvements can be sought. The DI has 
rejected two alternate models which would provide different 
values: a series of part-time courses tailored to the needs of 

individual recruits; and a prolonged program (such as Career 
Training) which would provide more time for the covering these 
wide-ranging needs. 

The following specific recommendations for the NAC were 
raised, mostly by the DI Panelists. 
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1. Concept Papers. Too many draft assessments still show 
a diffuseness of purpose that encumbers the review process. 

New analysts must tailor their assessments to a specific 
audience and purpose. Concept Papers constitute essentially a 
contract between analysts and managers, and the NAC should 
introduc e a unit on th e value of and formats for Concept 
Papers. ^who spoke most forcefully to the need for 

such a unit kindly volunteered to present it at the next 
running of the course. 


2. Comput^X-.Sk'ills. ADP competency will be essential to 
the future functioning of the Directorate, and an expansion of 
the present two and one-half days of instruction will probably 
be needed as this increased dependency develops. In fact, the 
NAC now includes five days on ADP. 

3. The NAC should increase its attention both to research 
and to non-poli t ical analysis . The unit on source 

f ami liar izertTrCfTT for example, can address data bases as well as 
time-sensitive traffic. And the writing drills can include an 
article for the weekly economic serial. An exercise on 
conventional military analysis has already been added. 

4. In this context, of broadening the definition of what 
is important to the Directorate and therefore career enhancing 
for new analysts, the Panel recommended that the standard of 
"Publish or Perish" be replaced with "Perform or Perish." 

Toward this end, new analysts should be instructed that they 
are expected to develop competency in all aspects of 
intelligence analysis: e.g. , the development of data bases as 
well as policy-relevant current analysis. 

SEMINAR ON INTELLIGENCE ANALYSIS (SIA) 


The Panel also strongly endorsed SIA. Both the student 
participants and the sponsoring office managers see the course 
as providing substantial and distinctive values in the form of 
greater capability to apply discipline (structure) and 
creativity to analytical assignments. 

The main concern was how to cope with the analysts' 
perception of the lack of positive organizational incentives 
for applying the techniques learned in the course. No one 
could come up with a credible definition of the source of the 
resistance — although it was suggested it might be the residual 
influence of long-retired "city-room" supervisors. 

In a post conference discussion of the problem of 
resistance to change, Panel member Bob Dorn recommended that 
division chiefs be tasked to provide the needed incentives, 
since they can afford to take more risks than branch chiefs. 


STAT 
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The Panel also recommended increasing the post-course 
impact by structuring each class with clusters of four or five 
students from three or four divisions or offices. This 
arrangement will be attempted in the near future — in order to 
provide some commonality in substantive specialities (not 
available when the students represent all the DI offices) and 
also some diversity in organizational dynamics (not available 
when the class represents a single office). 

The Panel agreed that SIA should continue the recent trend 
of accepting analysts with three to five years of experience 
( rather than the old norm of seven or more years ) . 

One of the DI Panel members indicated that SIA should 
nonetheless still be seen as a course for a limited number of 
analysts. The non-CIA members, in contrast, thought that all 
or most analysts should be exposed to the values of the course. 

SEMINAR ON INTELLIGENCE SUCCESSES AND FAILURES (ISF) 

The Evaluation Panel also strongly endorsed ISF as 
presently constituted, in terms of the beneficial impact on the 
students and on the Directorate. 

r 

One of the DI members suggested th at -junior analy sts, on 
the recommendation of their division chiefs, be accepted for 
the Seminar. 

THE NEXT MEETING OF THE EVALUATION PANEL 

Tlie next meeting of the Evaluation Panel is tentatively 
scheduled for the 10 January 1986. 

During the 26 June conference) concern about the 
development and training of branch chiefs was repeatedly raised 
as a priority concern in the Directorate. Because of a 
relative dearth of senior analysts, new branch chiefs are being 
selected with less experience than in the past. Moreover, 
there are fewer experienced analysts in their units to share 
the responsibility for supervision and on-the-job training. 

Consequently, the January meeting of the Evaluation Panel 
will address the Supervision of Analysis Seminar -- a two week 
course for new branch chiefs, as well as other OTE supervisory 
courses . 

At the same time, the Panel could discuss what other 
services the Office of Training can provide to address the 
general problem of relatively inexperienced and overtaxed 
supervisors. Perhaps arrangements can be made for course 
directors and DI annuitants on contract to OTE to visit the 
branches periodically to assist with on-the-job training 
(circuit-riding instructors). 
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Test Instrument 
Career Anchors 

Work Style Preference 
Thinking Styles 
>^ers -Briggs 


FIRO - B 

ALPORT/VERNON/LINDZEY 

GUILFORD/ZBflERMAN 

COOPERATIVE/COMPETITIVE RELATIONSHIPS 
TJOSVOLD/ANDREWS 

Turn Around Simulation 

XY Exercise 


Cottrse 

Advanced Intelligence Seminar 
Midcareer Course 

Advanced Intelligence Seminar 

Midcareer Course 

Introduction to Intelligence Assistance 

Experienced Intelligence Assistants Course 

Intelligence Analysis Course 

New Analyst Course 

Seminar on Intelligence Analysis 

Supervision of Analysis Course 

Executive Leadership Forum 

ELF Courses 

ELF Courses 

ELF Courses 


ELF Courses 
ELF Courses 


Sanitized Copy Approved for Release 2010/10/19 : CIA-RDP87-00956R0001 00050004-9 



Sanitized Copy Approved for Release 2010/10/19 : CIA-RDP87-00956R0001 00050004-9 


INSTRUMENTS USED IN MATD 


COURSE 

INSTRUMENT 

DESCRIPTION 

Leadership Styles 
& Behavior 

Styles of Leadership 
Survey (Hall & Williams) 

Measures one& 
managerial style 
according to 
managerial Grid. 

Management 

Development Course 

Management of Motives 
Index (Hall) 

Assesses assumptions 
and practices which 
characterize the 
manager's attempts to 
motivate others 


Conflict Management 

Survey (Hall) 

Surveys one ' s 
characteristic 
reactions to and 
handling of conflicts 
between oneself and 
others . 

Looking Glass, Inc. 
(LGI) 

Skills Assessment 

Form 

Assesses managerial 
skills of 
participants . 

Program on Creative 
Management 

Health Risk 
^praisal 

Being discontinued 

1 Jan 86. Predicts 
medical areas of 
future concern. 


Situational 

Leadership 

Questionnaire 

Measures style of 
management 


Kirton Adaption- 
Innovation 

Measures differences 
in how participant 
defines and solves 
problems because of a 
preference for 
adaptive or 
innovative approach 
to new information 
and change . 
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CX)URSE 


Supervisory 
Counseling Course 


INSTRUMENTS USED IN MATD 


INSTRUMENT 


DESCRIPTION 


FIRO-B 


California 

Psychological 

Inventory 


Explores the typical way 
participant interacts with 
people . 

Psychometric instrument 
with 18 scales measuring 
psychological well-being 
and behavior. 


3-S Questionnaire Measures a person's 

preference for structure 
in the work environment. 


Myers-Briggs Type 
Indicator 


Managerial Job 
Satisfaction 
Ques t i onna ire 


Indicates how the 
participant prefers to 
look at things and go 
about deciding things. 

Measures level of 
participant satisfaction 
with management and 
comparison of responses 
with data base response. 


Strong -Campbell Helps people make 

Interest Inventory occupational decisions by 

identifying patterns in 
likes and dislikes and 
comparing patterns with 
those of people in a wide 
range of occupations. 


Leadership Decision Indicates leadership 
Styles Survey decision style preference 

in 16 situations. 


Leadership Style Accesses managerial skills 

Indicator (LSI ) of participants. 


C onflict Management Assesses the overall 
Instrument (USC) conflict management style- 

competing vs collaborati 3 j^j 
etc . 
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17 October 1985 

SUBJECT: Instruments Used in Administrative Systems Branch Courses 


Career Development Strong Campbell Interest Inventory 

Helps individual understand work interests 
and shows some kinds of work in which they 
might be comfortable. 


Women in the Work Force Personal Profile System (1) 

Identifies work behavioral style. Helps 
individual understand self and others in 
the work environment. 


Effective Development 
Course 


Myers-Briggs Type Indicator 

Shows how individuals look at things and 
make decisions. Individuals learn their 
preference and the preferences of others 
which helps them understand how people 
relate to each other. 


Values Analysis Profile (Massey) 

Helps individual identify value systems 
which gives insight on how they approach 
decisions and choices. 


Management Skills for Strength Deployment Inventory (2) 
Secretaries and 

Administrative /Assesses the strengths used in relating 

Assistants (MSSAA) to others under two condit ions - -when 

everything is going well in relationshijis 
and when faced with conflict and 
oppos i t i on . 
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MSSAA Job Descriptive Index (3) 

Indicates how individual currently feel 
about different aspects of their job. 

Myers-Briggs Type Indicator (3) 

(See above) 


Strong Campbell Interest Inventory (3) 
(See above) 

Fundamental Interpersonal Realtions 
Orientation-Behavior (FIRO-B) (3) 

Looks at interpersonal behavior. 


(1) Used once so far by one contractor 

(2) Used regularly by one contractor 

(3) Used in CCL version of MSSAA 


Sanitized Copy Approved for Release 2010/10/19 : CIA-RDP87-00956R0001 00050004-9 



Sanitized Copy Approved for Release 2010/10/19 : CIA-RDP87-00956R0001 00050004-9 


24 October 1985 


MEMORAHDUM FOR: Chairman, Curriculum Committee 

FROM: I 

Chief, Career Trainee Division 
SUBJECT: "Instruments” Used in CTD Courses 


STAT 


1. Myers-Briggs is "used" in the Interpersonal Skills and 
Orientation to the DI segments of the Career Trainee Development 
Course. The CTs have already taken the test as part of their 
EOD processing but have not received feedback (although one of 
the PSD psychologist, ^ does go over this test with 

the people he interviews ) . The test itself is discussed in the 
Interpersonal Skills segment and feedback is given to help the 


The test 

ov^iiox Segment and feedback 

CTs understand themselves better and thereby facilitate their 
interaction in groups. The Myers-Briggs instrument also is 
touched on lightly in the DI portion of the CTDC in an effort to 
provide information on how analysts perceive other analysts in 
the workplace. 


STAT 


2. NUSITE will be done for the first time in the 
Administrative Trainee Course on 1 November 1985 by Helen 

I This course is for CTs going to the Administration 
Directorate. I 


STAT 

STAT 
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i IINIST/IATIVE-INTERNAL use ( LY 


OFFICE OF XRAININC AND EDUCATION 
INSTRUCTION 


MANAUEMENT OTE INSTRUCTION 81-12 

5 October 1901 


COURSE REPORTS 

1* The purpose of this Instruction Is to provide 
guidance for preparing and submitting Office of Training and 
Education course reports to the Director of Training and 
Education, • OTR INSTRUCTIONS TRI 7-*l, dated 20 June 1977. 
and TRI 7-3/78. dated April 1978, are rescinded. 

2. Annual course reports are to be prepared on Office 
of Training and Education courses. The. due date for annual 
course reports Is 15 January. New Office of Training and 
Education courses will have End-of-Course Reports prepared 
for each of the first three runnings and are due within 
10 working days after completion of the course. Thereafter, 
course reports will be submitted annually. Courses or 
workshops conducted on a special or ad hoc basis will also 
require an End— of— Course Report at the .completion of each 
running. Deviations from this schedule of reporting will be 
established on a specific case basis by the Director of 
Training and Education and the school chief Involved. 

3* In preparing course reports, course directors 
should provide a reasonably comprehensive accounting of 
successes and failures in meeting course objectives In a^ ' 
brief report (ho more than three pages In length). The 
course schedule, containing scope notes and guest speakers, 
will be Included as an attachment. To establish uniformity 
In course report content, course directors should use the 
following general outline: 

Introduction 


This paragraph Includes an Identification of the 
course: whether It was a regular or a special 

running, when and where the course was run, and how 
many participants attended. Detailed statistics on 
course costs and student grades, ages. Agency 
service, home directorate, etc., will be Included 
only If the Information adds significantly to an 
understanding of the course. 


•The Language School will be exempt from the general guidance 
outlined In this Instruction, but It will continue Issuing Its 
own course reports. 
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A. .nistrative-internal use ( 


Summary 

This paragraph Ineludea highlights of successes and 
failures in nesting course objectives, significant 
participant or speaker presentations, and concerns 
relating to events and trends affecting the Agency* 

Evaluation 

This paragraph includes an overview of 
participants' evaluation of course and whether 
course objectives were of value, etc* 

Recommendations 

This paragraph includes recommendations of the 
course director on the course (improving course 
objectives, parts to change, parts to keep the 
same, etc*)* 

4* Course reports will be disseminated as follows: 

--The original copy will be forwarded to the Director 
and Deputy Director of Training and Education via 
the Executive Officer and the appropriate school 
chief* The original copy will be returned to the 
course director for retention* 

--A copy will be forwarded to the Plans Group; Chief, 
Administration Division; Chief, Training Support 
Division; and Chief, Central Registrations 
Branch. This copy will be retained by 

Registrations for six months and then destroyed. 

— Copies, with course schedules, will be forwarded to 
the Senior Training Officers for the National 
Foreign Assessment Center, Directorate of 
Operations, Director of Central Intelligence Area, 
and Directorate of Science and Technology for all 
Office of Training and Education courses In which 
their employees are enrolled. These copies should 
accompany the original course report to t e 
Director of Training and Education. The Senior 
Training Officer for the Directorate ol 
Administration will be provided copies of course 
reports only upon his request. 

— Copies of course reports may be provided to other 
Office of Training and Education school chiefs and 
Instructors for Information purposes. 


2 

ADMINISTRATIVE-INTERNAL USE ONLY 
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/ -INISTRATIVE-INTERKAL USE ( 'A 


Additional dlaaemlnatlon outside the Office of Training and 
Education of course reports or Information contained therein 
will be at the discretion of the Director and Deputy 
Director of Training and Educ ation « 


STAT 



Director 

of 

Training and Education 
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